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ABSTRACT 

Some geometric properties of the wavelet analysis performed by visual neurons are discussed and compared with 
experimental data. In particular, several relationships between the cortical morphologies and the parametric 
dependencies of extracted features are formalized and considered from a harmonic analysis point of view. 
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1. INTRODUCTION 

The functional behavior of neurons in primary visual cortex can be partially modeled as a linear response 
to visual stimuli. This linear response can be formally described as a generalized wavelet analysis of images, 
intended as functions from to (we consider greyscale images), with respect to a family of functions 
C Such a family can be indexed by a parameter set T that encodes some relevant geometric 

properties, which correspond to local features of the input image, and that is mapped on the cortex. Each 
neuron can be identified with a given collection of such properties, i.e. by an element of T, and it is said to be 
selective with respect to the associated features. A neuron receives a visual input only from a bounded region in 
the visual plane. Inside this region, which is called the receptive fields a neuron can be selective with respect to 
several local features^ such as the local orientation, the local spatial frequency (the rate of oscillations), the local 
apparent velocity (the component of the speed of motion that is orthogonal to the locally detected orientation). 
The neurophysiological and computational meaning of this selectivity will be discussed in sections and 

The primary visual cortex (VI) of many mammals, notably including human^ shows a remarkably regular 
spatial organization of the features its neurons are selective to.H^ VI is arranged in such a way that each feature 
varies smoothly on the cortical layer: neurons that are close to one another are selective to similar features. 
Receptive fields are arranged in a topographic, or retinotopic way, i.e. neurons that are close to one another in 
the cortex are associated to similar regions in the visual plane. They are also highly overlapping, in the sense 
that two adjacent neurons respond to two almost entirely overlapping regions. Orientation varies smoothly, in 
the sense that two adjacent neurons are selective for similar local orientations, and the same is true for the other 
listed features. Moreover, the variability of some of the features is mainly associated to the horizontal position 
of the neurons, according to a so-called hypercolumnar structure whose discovery dates back to the Nobel prizes 
Hubei and Wiesel. The cerebral cortex can be thought as a thick layered stack of (folded) planes and, roughly 
speaking, the hypercolumnar paradigm postulates that the function (feature selectivity) of neurons does not vary 
along the transversal direction but depends only on the position on the cortical plane (see alscP^. 

This structure has led to the representation of the functional architecture of primary visual cortex in terms of 
maps from the cortical plane to the space of a given feature, called cortical maps, which describe the displacement 
of the neurons in terms of their selectivity.!^ Probably the best known cortical map is that of orientation 
preferences, depicted in Figure It is a map 0 : ^ [0, tt) that indicates, for each point on the cortex, 

what is the orientation the underlying neuron (population) is selective to. This means that if a light stimulus 
is present in the receptive field of a neuron, and that stimulus is mainly oriented along the depicted direction 
(e.g. it contains an edge with that orientation), then the neuron will be maximally stimulated. Conversely, if 
the stimulus contains an edge in the orthogonal direction, the neuron is minimally stimulated. 
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*Most of the experimental data reported here involve primates such as humans and macaques, close relatives such as 
tree shrews, but also cats, and similar behaviors have been encountered in carnivors like ferrets. Notable examples of 
morphologies that are different from the ones discussed here are provided by rodents.!^ 
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Figure 1. Left: a planar representation of a tree shrew Vlp^ colors represent preferred orientations of the underlying 
neurons. The map is almost everywhere smooth with almost-periodic displacement of topological singularities, around 
which all orientations are represented. Right: single neuron measurements of preferred orientation at various depths in 
cats.^ The feature of local orientation depends only on the horizontal position and does not change transversally. 


A satisfactory understanding of the properties of the family or of the cortical representation of 

the set X from the point of view of image processing is still an open problem, even if many partial results 
are available. This issue is relevant for artificial vision, because the capabilities of analyzing, compressing, and 
processing images possessed by the visual cortex still outperform any artificial system. It is also relevant for 
neuropsychology and cognitive studies, because it is still not clear what is the role of the different constituents 
of the brain in order to build the structured and organized visual representation generated by the visual cortex. 
On the other hand, this approach suffers from several limitations: just to mention a few, it does not include 
the various nonlinear mechanisms that contribute to the neural responses, and it does not take into account the 
dynamics of the network of connected neurons as well as the dynamic of activation of each single neuron. 

The purpose of this paper is to review some key facts about mathematical models of neurophysiological 
behaviors, to show some new properties of these models, to present some open problems that can be of some 
interest to the community working on harmonic analysis and approximation theory, and to provide some relevant 
terminology and references commonly used in the neuroscience literature. 

2. A VERY BRIEF SUMMARY OF SOME VI CELLULAR BEHAVIORS 

In this section we will introduce the main features of VI that we will consider. We will focus on linear be¬ 
haviors and on cortical maps, disregarding the several issues on nonlinear behaviors, such as normalizations or 
surround effect sjHEHlSl on dynamical effects, such as spatio-temporal behaviors of receptive profiles jSllEll neural 
oscillations,^^ nenrodynamics {SEUEll FnP^ or on properties of connectivitie^ISlEll and their geometric modelsElEIl 

Primary visual cortex VI is the first and largest cortical area dedicated to the processing of visual stimuli. 
It is located in Brodmann area 17, involving both hemispheres of the occipital lobe of the brain, and it is 
also called striate cortex. It is followed by higher visual areas, from V2 to the so-called V5/MT, also called 
extrastriate cortices^ that are located in Brodmann areas 18 and 19. VI receives direct sensory input from the 
lateral geniculate nucleus LGN, which is located in the thalamus and acts as a preprocessing unit of the visual 
stimuli collected by the retina. The ^10^ retinal receptors are connected by ^ 10^ optic nerve fibers to the 
LGN and finally to the ^ 5 x 10^ VI cellsHUlZll On the one hand, this gives a strong indication that alredy in the 
retina there must occur a cospicuous processing of information. On the other hand, the 10^ units of infomations 
reaching VI are evidently highly reprocessed. VI transmits its information to extrastriate cortical areas by 
connections to V2, which is then connected to higher visual areas. The electric inputs that VI receives are due 
to three main classes of connectivities: feedforward inputs coming from the eye, through the lateral geniculate 
nucleus; lateral inputs coming from other VI neurons; and feedback inputs coming from higher cortical areas. VI 
neurons are characterized by their feature selectivity, by their physical displacement, and by their connectivities. 
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2.1 Classical receptive fields 

Just like all neurons, the neurons that populate VI accumulate an electric potential on their boundary membrane 
by means of chemical mechanisms involving ion concentrations. When this electric potential exceeds a given 
threshold, the neuron releases an impulsive discharge called action potential^ that is transmitted by synapses as 
an electric current. Such current flows through connections until it reaches other synapses, where it is again 
converted into an electric potential that accumulates in the neuron that receives the signal. A neuron that emits 
an action potential is said to be firing^ the action potential itself being called a spike. The activity of a neuron 
is its temporal sequence of spikes, and it is generally quantified by a nonnegative scalar quantity that measures 
its average firing rate^ that is the frequency of spikes per second that it emits.l^ A neuron has always a positive 
firing rate: even when there is no external stimulus acting on the network, each neuron fires from time to time 
(rest state). The activity of a neuron is then measured as the difference between its firing rate and the firing rate 
at resf[^ The firing rate depends in a nonlinear way on the membrane potential, which is generally modeled as 
a sigmoid function; in particular, each neuron has a maximum firing rate, a linear range of membrane potentials 
where the firing rate is linear, and a minimum firing rate equal to zero. 

A VI neuron’s visual receptive field is defined as the remon of the visual field where the presence of light 
(i.e. a visual stimulus) causes a neural response. The direcflq activity response of a neuron to a stimulus does 
not depend only on the stimulus location on the visual field, but also on the spatio-temporal distribution of 
the light in the receptive field region. One of the basic needs of a neurophysiologically based formal theory of 
visual perception is to have a quantitative description of such dependence, that is sufficiently accurate to allow to 
predict the response of a neuron to any chosen visual stimulus. The simplest (though very effective) model is the 
Linear-Nonlinear-Poisson model. Even if it does not account for many nonlinear and/or collective phenomena,!!^ 
it is able to reproduce much of the single-neuron behavior. It consists of three stages: 

1. The visual stimulus produces a feedforward input that feeds a neuron ^ with a voltage: this voltage is 

considered as depending linearly on the visual stimulus. If / : ^ M+ is a visual stimulus, then the 

resulting membrane potential is a linear map V : / i-^ M generally realized as an I/^(]R^) linear functional 

where the vector depends on the specific neuron. 

2. Activity is computed by applying to VPf] a static nonlinearity, generally a sigmoid ^(r) = - 

^ 1 — e 

3. The firing process is considered as a Poisson process whose rate is given by ^^[f] = This is 

equivalent to assume that no information is encoded in the time process of spikes. 

The fundamental objects of the LNP model are then the filters where X represents the family of 

visual neurons. They are generally called receptive profiles^ or also classical receptive field^ Other effects, which 
take place in outer regions and/or that contribute nonlinearly to the receptive profile behavior, are referred to 
as nonclassical or extra- classical^^!^^ 

In order to describe quantitatively the receptive profiles, one needs to set up an experimental framework that 
allows to measure them. The technique used is borrowed from a technique introduced by Wiener, that is called 
white noise analysis^ or spike-triggered average or, more commonly, reverse correlation. It basically consists of 
showing random sequences of stimuli while performin electrophysiological recordings of the spike trains produced 
by a neuron, and performing averages over the stimuli that preceded a spike. In this way one identifies the type 
of stimuli that generate the highest linear response of the neuron. This in general is not sufficient to describe the 
complete behavior, which is more properly described in terms of so-called Wiener series including nonlinearities 
of different types. The procedure is however made consistent by imposing the LNP model to this stochastic 
analysis .1^ 

^This does not account for all the information that is handled by the neural systems, and other quantities may be 
involved such as subthreshold activities.^ 

^We are disregarding here the activity due to lateral and feedback connections. 

^The expression “receptive field” can be found in the literature to indicate either a filter or its support. 
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2.2 Cortical maps of feature displacements 

Effective experimental techniques have been developed to visualize large portions of cortical tissue activity in 
vivo. They are called optical imaging^ and rely either on volt age-sensitive dyes or on intrinsic signals^ The 
first one, developed in the 70’s and 80’s makes use of dye molecules that are capable to transform changes 
in the membrane potentials into optical signals. This technique offers a temporal resolution of about 10“^s 
and a spatial resolution of about 10“^m = 100/im, while the produced signals do not correspond to single cell 
activity but are due to the averaged electric activity of a local population of neurons (about 250-500 neurons). 
This technique is considered most often for real-time measurements. The second one, developed in the 90’s, 
is based on the intrinsic changes in the amount of light reflected by brain tissue, which is correlated with the 
presence of neuronal activity. This mechanism is thought to arise at least in part from local changes in the 
blood composition that accompany such activity, which can be detected when the cortical surface is illuminated 
with red light. Active cortical regions absorb more light than less active ones. This technique provides a more 
accurate spatial resolution of 50/im or better, but it provides a very low temporal resolution. However, since the 
experimental set up is easier, it represents the most frequently used technique to obtain cortical maps. More 
recently, noninvasive techniques with fMRI have been used to provide evidence of orientation maps in humans .1^ 

In Figure one can see the experimental data that produce the map of Figure The anesthetized animal 
is presented with a plane wave (called grating) drifting back and forth along a given direction, and the cortical 
activity is measured in terms of intrinsic signals. One obtains then a collection of maps indexed by a parameter 
0 G [0, tt), that we can denote with A : x [0, tt) ^ M, where ( i-^ A(C, 0) represent the local activity around the 

point ( on the cortex with respect to the orientation 0. Observe also that 0 A(C, 0) provides the orientation 
tuning of the neurons located at C, i.e. their selectivity curve to different orientations The information 
about the local orientation preference given by the map 0 depicted in Figure is obtained by the vector sum 

0(C) = iarg^T*2M(C,0)d0. 

Since at each ( this depends only on one Fourier coefficient of ^ of course it can not contain all the 

information given by the function A. As a consequence, different activity maps can produce the same orientation 
preference map. More precisely, since 

0(0 = t arg (026(0 £ 02M(C, e + e{0)de), 

then for all A such that the integral at the right hand side is real one obtains the same map 0. Several experiments 
have thus focused on the joint displacement of orientation preferences and orientation tuning.!^ 



Figure 2. Left: orientation-dependent activity maps in tree shrews.^ Center: vector sum to obtain orientation preference 
maps in cats.^ Right: small differences in orientation preference depending on high (top) or low (bottom) spatial 
frequencies of the presented gratings in cats.^ 


Another well studied cortical map concerns the columnar organizations associated to ocular dominance 
that consists of columns where all cells respond preferentially to the same eye. They show a regularly organized 
structure, which is strictly related to that of orientation preference. However, for the present purposes of the 
analysis of purely two dimensional visual stimuli, binocularity does not seem to play a central role,l^ so we will 
disregard completely issues regarding ocular dominance. 
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Figure 3. Left: coordinates on VI (edited fronP^. Right: (A) stimulus used for mapping the retinotopic projection onto 
striate cortex; (B) pattern of response in macaque VI produced by this stimulus pattern!^ 

3. RECEPTIVE FIELDS MORPHOLOGIES 

This section is devoted to the introduction of some formal properties of classical receptive fields, regarding 
locations, sizes and shapes, that can be deduced from experimental data. 

3.1 Retinotopy, size and magnification 

VI possesses a three dimensional layered structure. We will consider each layer as flat and continuous, and 
distinguish coordinates on the two dimensional leaves from the transversal coordinate. Some relevant features 
that will be addressed are indeed approximately constant when measured transversally on vipam while others 
are commonly considered in average over the layers: for this reason the two dimensional space corresponding to 
layers is sometimes called the cortical plane. Each VI cell will then be identified by a point 

e = (C,MeVl=MLtexX[0,F]. 

We will keep the subscript cortex in order to distinguish each such plane from the retinal plane which 

we will identify with the visual field (this is reasonable only locally: the optical properties of the eye and the 
retina require spherical coordinates, and for this reason the distances on the visual field are generally measured in 
angular degrees). VI cells can be classified in terms of several properties which concern their functional behavior, 
typically parameters of their receptive profiles. Let a given property be described by the elements of a set X. A 
Cortical Map is then defined as a function 

m : VI ^ X 

that associates to a cell at ^ a property m(^) G X. 

The first properties one is interested to are related to the location and size of receptive fields: if C KLina 
is the receptive field of the cell at denote its center with 

and its size with 

5'(0 =dmm{n^). 

Each VI layer ®Lrtex is organized in a retinotopic waypHEH i.e. for any fixed h G [ 0 ,iL] we have that 

g(-, h) = (t)h: M^^rtex ^ ^^?etina 

is a smooth bijection. Moreover, for each fixed ( G ^cortex variation of g(C, h) with /i, usually referred to as 
scatter^ is small and for the present purposes it can be considered negligible, so we will drop the subscript h 
and simply denote the topographic map as 0. This map is approximately given by the (principal branch of the) 
complex logarithm, also called log-polar mapEHEH for {x,y) G I^retina let 2: = x + then 

: {x,y) ^ {r,0) = ln( 2 ;). 

The map 0 is conformal, i.e. it preserves angles, because 7 ^ 0, and its geometry can be understood by noting 
that rotations and exponential dilations are mapped as translations: for a G 5'^, and t G 

f = {r,0-\-a) 

\ (j)~^{e^z) = (r + t, 6 >). 
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Figure 4. Electrophysiological measurements in macaques VI.® Left: size and scatter of receptive fields in a transversal 
penetration, for different depth. Right: receptive field size-plus-scatter and magnification, for three different eccentricities. 


A quantity commonly used to quantify properties of the distribution of receptive fields is the Cortical Magnifi¬ 
cation Factor CMF.® It measures the distance on the cortical surface between two neurons having RF positions 
whose distance S on the visual field is small: 


CMF5(Co) 


max 

C--\HC)-HCo)\<s 


IC-Co|. 


Making use of the log-polar mapping and denoting with zq = ^(Co)? since 


CMF5 (Co) = max |(/) ^{z)-(j) ^(^o)! 

z:\z — zo \ <6 


max I In (z) — In ( 2 : 0)1 

\z — zo\<6 


max 
w: |w|<(5 


In 



_s_ 

kol 


we get 


CMF5(Co) zzf- = -. 

po 


( 1 ) 


A related notion is that of point image PI: it is defined as the square root of the cortical surface area activated 
by a point in the visual space. It is then approximately proportional to the distance on the cortical surface at 
which two cells have separate receptive fields: 


Pl(Co) 


max 

C:c^(0(C),<^(Co))<S(^o) 


IC-Col. 


The point image is measurecP^ as the product of the average receptive field size times the CMF at ^ = 1 degree 

PI(Co) ~ (5) Co CMFi(Co) , (5) Co = f I S{(o, h)dh (2) 

which is consistent with the linear approximation 0- 

While and its derived quantity CMF depend only on the surface coordinate C, it is not so for S', which 
actually depends both on C and on h: at any fixed ( there are several scales S, which suggests that a multiscale 
analysis is performed. On the other hand, if one considers the average S over h and looks at the variability with 
respect to the horizontal position C, one sees that the size of receptive fields becomes larger as approaching the 
periphery of the visual field, at almost the same rate due to the log-polar map (see Figure [^. This makes the 
point image an almost constant quantity over the whole VI surface.® 

The log-polar mapping and the enlargement of the receptive fields towards the periphery of the visual field 
imply that the visual system performs a more refined analysis close to the fovea, losing precision towards the 
periphery. This is coherent also with the distribution of the density of retinal receptors, which is higher close to 
the fovea. The constancy of the point image implements the complementary principle of dedicating approximately 
the same amount of cortical tissue to the processing of local information over the whole visual field. 



Figure 5. Left: electrophysiological measurements in catJ^ of CMF and of the local average of S against distance from 
the VI point where the fovea is mapped (“eccentricity”). Right: fMRI measurements in humans.® 
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3.2 Orientations and shapes 

The majority of VI neurons respond mostly to moving oriented stimuli, so their receptive profiles are more 
properly described by spatio-temporal filtersEHIllI Neurons with static behavior are called simple cells^ in contrast 
to spatio-temporal behaved neurons that belong to a class called complex cells^ However, simple and complex 
cells have some common spatial characteristics,^^ which consitute the only behaviors we will consider here. 

Measurements of LNP receptive profileJ^ show very good fits with the so-called Gabor models that is given 
by a sinusoid oscillation under a Gaussian bell. They are defined on the retinal plane/visual field in terms of 
parameters [3 G [0,7r/2), n G and a = (^ 2 )’ where (Ji^(J 2 ^ 1^^ as 




^retina 


{Xi,X2) H> 


M 

—= cos(27r/^xi -h P)e e ^^2 


and are considered to be translated and rotated in all configurations on the visual field. More precisely, for 
/ : ^ C let us denote with Tq and Rq translations and counterclockwise rotations on the plane 


Ref{x) = f{rex) , 0 e = [0, 27r) , re 

Tqf{x) = f{x-q), qe 


cos 0 — sin 0 

sin 0 cos 0 


Any neuron located at ^ G VI is associated to a receptive profile = TqReg^^^^{x)^ where the parameters /3, 

cr, g, 0 depend on the neuron The dependence of g on ^ was discussed in the previous section. For cr, one 
can approximately consider the introduced quantity S as corresponding to 2{ai + ^ 2 ), since most of the power 
is contained within two standard deviations. The cortical map 0 accounts then for the dependence of ^ on 

With respect to /d, a common simplification can be performed: since most VI neuron^ have a value of 
P equal to 0 or 7r/2, i.e. they are described either by a pure sine or a pure cosing the cosine+phase term 
can be approximately substituted by a complex exponential without phase, meaning that both the real and the 
imaginary part provide a receptive profile. This produces the simplified model 




9 k 


e 


TqRegl{x) = 


^2'KK{{x-i—q\) cos 9-\-{x2—q2) sin 0) ((cci-gi) cos d-\-{x2-q2) sin 61)^ ( - (cc i - ) sin 6> + (£C2-<?2) cos d)‘^ 

^ 0^2 0^2 


(3) 




This model allows also to include easily a characteristic of complex cells. Their response is indeed generally 
well described by a slight modification of the LNP model, called the energy mode/,which consists of passing 
under the static nonlinearity not the linear filtering, but the square modulus of (§, hence losing the phase: an 
input stimulus / : ^retina ^ induces an activity on this type of neurons determined by a firing rate 
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Figure 6. Data fit with Gaussian Gabors in macaque monkeys.^ 


^Traditionally, the cosine ones were called even eells while the sine ones were called odd eells. 
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3.3 On model parameters and topological dimensions 

The model of VI receptive profiles given by (§ is made of 6 parameters n^ 0 ^qi^q 2 and cri,cr 2 , but VI is only 
three dimensional, so only a subset of parameters is actually implemented. The bijection due to the retinotopic 
mapping allows to consider the parameter q to depend approximately (up to the scatter) only on the two 
horizontal cortical coordinates C. On the other hand, the evidence for orientation hypercolumns shown in Figure 
[fallows us to consider the orientation parameter which depends essentially only on C, to be a function of q. 
With respect to the spatial frequency parameter /^, experimental evidence for a columnar structure is less clear, 
as weakly ordered maps are observed from intrinsic signalbut their structure is debated.l^ In any case the 
system of Gabor functions ^ cannot make use of all frequencies at any point. Moreover, since the transversal 
dimension of VI is finite, clearly also all scales can not be represented. If one wants to consider the linear 
transformation performed by VI receptive profiles, which is the main contribution to the feedforward voltage of 
cells, as a generalized wavelet transform of an image, some special characterization of the space of parameters 
actually present in VI is needed in order to understand its functional behavior and its computational purposes. 

In order to reduce the problem, a useful simplification is that of disregarding the log-polar mapping and 
replace it with a linear mapping from the retina to the cortex. This can be considered as a local approximation, 
which amounts to forget about the center-periphery difference in resolution and to consider the CMF to be 
a constant. In order to keep a constant size for the cortical point image, the dependency of scales should 
consequently be reduced to the vertical coordinate h only. From now on we will then consider the topographic 
mapping to be simply the identity, so that a first set of interparametric dependencies is provided by 

g = c, 0 = e{q), a = a{h), k = K{q, h) (4) 

where q is then the independent coordinate on the cortical plane, which coincides with the image plane, while h 
represents a transversal dimension defining the available scales over each position. The dependence of k is left 
for the moment free on q and h. Moreover, by ([^, this implies that the point image can be approximately set to 

2 

PI ^ 2(cri + (72) = — y {ai{h) ^ a 2 {h))dh (5) 

i.e. the receptive field size is considered to be given approximately by 4 standard deviations. 

An additional interparametric dependence is provided by the observation that spatial frequency and scale 
appear to be highly correlated. Several experiments have been performed in this respect, here we will focus on 
data of orientation selective receptive profiles from cats fitted with a Gaussian Gabor model^ and on previously 
cited data on macaques ,1^ where the author has introduced the adimensional shape indices 

Hi = nai , 2 = 1 , 2 . 

The index ni measures the number of oscillations under the spatial window, while the ratio between the two 
indicates the anisotropy of the two dimensional Gaussian bell. 

The relationship between spatial frequency n and scale cji is shown in Figure left, as a scatter plot where 
each point represent a neuron. Among the simplest model functions, one of the best fits is provided hy n = ^^^^32 
(red curve, 0.088 root mean square error RMSE). A pure inverse proportionality provides a slightly poorer fit 
(green curve, 0.095 RMSE) with nai = 0.315 which is about the mode of the distribution for the product nai; 
this differs slightly from the mean value nai = 0.34 (blue curve, 0.99 RMSE). Nevertheless, due to the shape 
indications provided by ni, it is relevant to observe in Figurej^ center, how that shape index is distributed among 
the observed neurons. These are cells that have been chosen for being selective to orientation. This selection was 
not performed in the data displayed in Figure right, showing the relationship between the two shape indices. 
One can see the actual presence of a significative amount of cells with poor orientation selectivity, corresponding 
to low values of ni. By computing the rotational uncertainty of receptive profiles, it is indeed possible to classify 
cells whose value of ni is smaller than 0.16 as unselective with respect to orientations .1^ Moreover, one can see 
that the distribution of ni in macaques is very similar to that found in cats, as was already pointed out.l^ 

We remark here that this correlation between receptive field size and spatial frequency, together with the 
variability of size with the transversal direction in the cortex, may be related to the apparently weak evidence 
of columnar organization of spatial frequencies 
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(blue) in cats.^ Center: histogram 


.im 


Finally, it may be relevant to observe that the available data show evidence of a cutoff frequency. Moreover, 
while the actual sizes and frequencies may vary among different species, the adimensional shape indices show an 
apparent universal behavior which is common at least to cats and macaques (and whose structure is not easily 
justified by means of standard optimization criteria!^, with an approximate upper bound 

m <n ^ 0.5. (6) 


4. HARMONIC ANALYSIS AND SYMMETRIES 

The linear behaviors of receptive field can be studied with instruments of harmonic analysis, focusing on the 
properties of the wavelet decomposition they perform on images and on the group symmetries associated to their 
shapes. This allows in particular to concretely formulate some open problems related to our visual system. 


4.1 Submanifolds in a group structure 

The set of receptive profiles can be fruitfully described, in an approximate way, in terms of the so-called affine 
WeyI-Heisenberg grow^^^ in two dimensions. This is a semidirect product Lie group possessing a combined 
structure of time-frequency, scales and rotations. It reads G = x x x 5'^ x M+, with composition law 

(g,p, t,6>,a) 0 (g',p',t',6>',a') = (g + ar^^g',p+ ^rep'H + t' + ap • r^^q' ,0 0' ,aa'). 

Let us consider an approximate relation between the two scales as ai = pa 2 for a fixed value /i, (Figured right, 

2 2 
X 2 

suggests a /i > 1; the case p = 1 was treated iiP). Then, calling g^{x) = ^ ^ denoting with 

p =/t:(cos sin^) (7) 

and with Daf{x) = y/(y) the ordinary two dimesional dilation operator, we have that ^ reads 

i;^{x) = TqReMi^.^^D^^g^{x) = TqMpR 0 D^^g^{x) = n(g,p, 6>, cri)p^(x). (8) 

Now, n(g,p, 6>,a) = TqMpRoDa is a projective unitary representation of G, because 


n(g,p,6>,a)n(g',p',6>',a') = TqMpReDaTq>Mp>Re>Da' = TqMpReTaq'DaMp>Re>Da' 

= TqMpRoTaq' MDaRo' Da' = TqMpT^-iRgRe'DaDa' 

= + arpq',p + ^np',9 + 9',aa'). 

The affine Weyl-Heisenberg group provides relevant symmetries for the analysis of multivariate data, as its 
structure contains as special cases the usual time-frequency, wavelet analysis and wave packets, as well as mixed 
behaviors 0113 It is well known that, in order to obtain resolutions of the identity, the whole group is too large 
and a proper subset needs to be considered. In the present case, a first reduction is provided by condition 0, 
which amounts to align the direction of modulations with the rotations parameter. If the mother wavelet is 
isotropic (i.e. /i = 1), this is equivalent to the elimination of the rotations, whose effect is totally incorporated 
in the changing of orientations of the modulation parameter (in ^ simply commute Rq with and use the 
rotational invariance of gi). For anisotropic mother wavelets, relation 0 constrains the dilation axes to be 
aligned with the reference frame provided by the modulation vector p. 
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A second reduction in the parameters space G implemented by VI can be ascribed to the approximate relation 


K = K{(Ji) + e{q) (9) 

showed in Figure]^ left, where the function K represents the fitting curve while e accounts for the discrepancies, 
which give rise to the variability in the distribution of ni. The models for K given by the inverse propor¬ 
tionality K{(7i) = ^ or by the rational dependence K{(7i) = are well-known relationships in the affine 

Weyl-Heisenberg group 0113 This amounts to model the linear filtering as a usual wavelet analysis (or a trivial 
modification of it) with a two-dimensional Morlet wavelet, whose role in image analysis for the detection of 
oriented features is well-known 01111 Since the data show that a relation n = K{(Ji) is not implemented exactly, 
this leaves space for some additional fine adjustments: the proposed dependence on q represented by the e term 
is suggested by the mentioned spatial frequency mapsEHHSEll 

Combining the constraints § and § with the ones given by Q, we can then approximately describe the 
parameter set X representing classical receptive fields of VI as the subset of G given by 


A = 



p, O^cFi) G G/Mt 


0 

cri 

P 


0(g) 

s(h) : g G , h G [0, 

{K[s{h))^e{q)) (cos 0(g), sin 0(g)) 


where the function 0 : ^ 5'^ represents the orientation preference map and the function s : [O^H] M 

represents the variability of scales with the transversal cortical direction. With this approximation, the set of 
cortically implemented receptive profiles can then be written, for an appropriate parameter p, as {n(^)g^}^^;t'. 

While there are apparently no models concerning the function s, which can probably be considered simply 
as a smooth bijection of [0,i7] onto some interval of scales [s, s], several modelJU U^I^ l^lMl have been proposed 
for the map 0. A common on^^is based on the observation that the power spectrum of orientation preference 
maps is approximately concentrated on a thin annulus, where it shows and apparently random behavior. Thus, 
a simple way to obtain quasi-periodic orientation preference-like structures is given by 


1 

©(9) = 2 


g27riO((7i cos sin Z(^ip)dip 


( 10 ) 


where ^ : [0, 27r] ^ G is a highly irregular function (eventually a random process) and Q. is the radius of the 
circle in the Fourier plane, corresponding to the inverse of the typical correlation length, see Figure For what 
concerns spatial frequency maps and the term e, despite some evidenc^^ of correlations with the map 0, they 
are still actively invest igated.^^ 



Figure 8. Left: orientation preference map in macaque and its power spectrum.^ Right: map generated by equation (10) 
and an example of function Z on the circle, where the height represents the modulus and the color represents the phase. 


This class of maps is well studied in optics,!^ in the present context they have been related to the irreducible 
representations of the group of rotations and translations ,1^ which is the symmetry involved in the detection of 
orientations for the families and some of their geometric properties as random fields can be extended to other 
symmetries.!^ By replacing the integral with a discrete sum ( [iq| , the associated quasi-periodic structure can also 
be obtained as results of nonlinear evolution equationJ^ for the optimization of the so-called coverage-continuity 
tradeoff, that is “to preserve as far as possible neighborhood relations in parameter space” ^ Similar patterns 
were obtained by generative models via Hebbian learning,!^ and lateral connections seem to play a crucial role 
for their formation during animal development.!^ 
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A currently open problem, which has been scarcely addressed in its full complexity,!^ concerns the properties 
of the system (or of even more realistic models of the implemented family of receptive profiles) con¬ 

sidered as a wavelet analyzing family. In particular, it seems natural to ask what are its capabilities to represent 
images, or more in general what can be said about the function spaces associated to its linear decomposition. 
This appears to be a basic step to understand also the computational role of the several nonlinearities that in¬ 
tervene in the neural code with different modulations of this first linear processing.!^ It would also provide some 
clearer indications on the primal information collected by sensory area VI and later processed by the different 
types of connectivities. 


4.2 Characteristic lengths and good coverage 

If one plans to perform a digital wavelet analysis in two dimensions with anisotropic wavelets, a natural approach 
may seem that of using all orientations over each point, i.e. to consider a stack of different oriented local 
measurements and to repeat it over the whole signal. However, visual cortex does not choose this strategy, 
since at each point q of the image all the filters available (by changing the transversal cortical coordinate) have 
the same orientation, which changes as the (horizontal) position q changes. A notion that tries to quantify the 
completeness of the representation of orientations is that of coverage^^ and an optimization with respect to it 
means requiring that all orientations be represented over each point, by means of the overlapping of adjacent 
receptive fields. In a quasi-periodic configuration like the one of orientation preference maps, this condition 
implies that the length corresponding to the point image must be of the same order of the correlation length of 
these maps. Indeed, in that case all orientations would be represented in average within that distance, and all 
neurons lying within that distance would have receptive profiles that overlap at least partially. This necessary 
condition for coverage can then be summarized, in terms of the discussed models, by the condition 


- 


( 11 ) 


where Q is the parameter in (10) and PI is given by (§. This condition was actually checked experimentally 
by observing the activity produced by a thin line ,!I^ see Figure Such a stimulus can indeed activate neurons 
at a distance not larger than the point image, and only neurons selective to the same orientation will respond. 
This experiment shows then that the point image is approximately of the same size as the distance between 
two cortical regions whose neurons have the same preferred orientation. We observe also that condition 0 is 
actually a constraint that links the maps s : [0,i7] ^ [ 5 , 5 ] and 0 : ^ [0,7r). 



Figure 9. Left: intrinsic signals of activity patterns in tree shrew’s VI produced by a thin line drifting in the visual space, 
at different time^^ (scale bar, 1mm). Right: schematic picture of the two farthest neurons activated by the light bar. 


4.3 Tuning curves and shape index cutoff 

Selectivity of VI neurons to local frequencies is often measured in terms of orientation tuning and of spatial 
frequency tuning curves, which quantify the decay of neural response for stimulus parameters that differ from 
the preferred onelUll^ While this phenomenon can be partially explained in terms of classical receptive fields, 
it also offers a favorable experimental setting for checking for nonclassical effect, typically dynamicaP^ and 
nonlinear /nonlocaEUEH deformations. Here we simply observe that the qualitative behavior of these tuning 
curves is captured by the elements of the Gram matrix of the system . Since this is meant to be 

only a rough approximation of the experimental results, for simplicity we will consider ai = (72 = a (i.e. /i = 1), 

and denote with ^pg,^,e,a{x) = q G e R+,0 G S\a G M+, the 

receptive profiles. 
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The square modulus of the Gram matrix for two elements at the same scale a reads 


ul^O 5 ^05 ^05 '0g,/^,0,a)L2(R2^ 

because (calling p = k.{cosO, sin6>)) 


= TT e 


2 ^— ^^ *^2 ^ —27r^a^KQ —27r^a^{K^—2KKo cos{9—9o)) 


( 12 ) 


f e 27r^poa:g27r^p(a; q) ^ ^ ^ 

_ 

|g|2 
e 4a2 

f g 27ti(po p)x^ J ^ 




a? 


iir 

= Tre 4a2 e 


-TT^a^lpo-pP 


The elements (12) can be considered as the energy of the response of a neuron to a stimulus shaped as a 
receptive profile. Since such a stimulus can provide the maximal linear response (diagonal elements) and is also 
parametrized by the features themselves, it offers a simple way to obtain tuning curves. The typical experimental 
setup for obtaining tuning curves consists of showing stimuli that produce an electrophysiologically measured 
response that does not depend on the absolute position of the neuron and is 7r-periodic on the angular variable. 
A simple way to obtain such a curve for a cell with preferred spatial frequency kq and preferred orientation 0 = 0 
is then via the following function 

2 ^ ^2 -27t^ a\Kl+^) ^ 


= G{0, K, 0, a|0, kq, 0, ay + ^(0, /d, + tt, a|0, kq, 0, ay = 7r^e 


^ cosh(47r^a^/i:/i:o cos 6>). (13) 


It qualitatively resembles well known model^ and shows the role of spatial frequency in the orientation tuning 
width. It is compared with actual measurements in cat in Figure 10 The observed higher sharpness of the 
real tuning curves is thought to be related to nonlinear/nonlocal additional cortical mechanisms EHHH 




Figure 10. Left: spatial frequency and orientation tuning curves for different values of the other parameter, in cats.® 
Right: the function ( p^ for a typical cell /^o = 0.6, a = 0.6, plotted with respect to a and 0 for different values of the 
other parameter (normalized to have a maximum value 1). Observe that a is in logarithmic scale. 


The elements (12) can also be used to obtain a relationship between the shape index eutoff and the eharae- 
teristie length (11), by an argument introduced iiP concerning correlations. The function 


CK,a{Q, 0) = G{q, n, 0, a|0, n, 0, ay + G{q, /d, 6> + tt, a|0, n, 0, ay = Tr^’e 


2 47r n ^ — 


|g| 


e 2 a 2 cosh(47r^n^ cos6>) 


(14) 


can indeed be considered as a measurement of energy autoeorrelation in space and orien¬ 
tation for a receptive profile having spatial frequency n and scale a, denoting with n = na 
its (isotropic) shape index. Since an orientation difference of 6> = | provides the minimum 
correlation that can be attained due to the orientation selectivity mechanism only, it may 
be relevant to observe what is the spatial distance at which a receptive profile has the 
same correlation due to spatial decay only. By ( p!4| ) one obtains 

CK,a(g,0) = C^,,a(0, b A = — = y21og(cosh(47r2n2)). 
z a 



I I I—I Figure 11. A vs n plot. 

The dependency of the ratio A = on the shape index n is shown in Figure 11 It 

is possible to observe that, for a value of n around 0.5, which coincides approximately 

with the cutoff bound one obtains a distance that is approximately 4 times the scale, providing an effective 
size of a receptive profile corresponding to what is inside 2 standard deviations. By ([^, this was considered 
to correspond approximately to the point image, and by (11) this length is apparently mapped on VI as the 
characteristic length of the quasi-periodic map 0. 


12 


































This can be interpreted as a principle of dimensionality reduction constrained to optimally independent rep¬ 
resentation of orientations^ in the following sense. As previously observed, VI does not have a sufficiently high 
topological dimension to implement all scales/frequencies and orientations over each point, so it has adopted 
compromises such as the one described by the coverage strategy. On the other hand, if we measure the indepen¬ 
dence of receptive profiles in terms of correlations, then the maximal independence with respect to orientations 
can be obtained equivalently by translations at a given distance. This distance can be estimated to grow with the 
shape index, as described by Figure [3 and reaches the characteristic length of the orientation preference maps 
at about the cutoff value for the shape index. At that distance, two receptive profiles can then be considered 
as collecting a sufficiently independent information that justifies a repetition of a new full set of orientations. 
Say it from another point of view, orientation preference maps may be a way to map a compact variable on the 
highly redundant sampling space of positions. However, spatial frequency variable is not compact, so in order 
to be projected down one needs a cutoff. The one provided by is consistent with the purpose of having 
maximal decorrelation at the distance corresponding to the quasi-periodicity of the map 0. Finally, we observe 
that frequency cutoff could be related to the finite resolution at the retinal level,!^ but due to the intermediate 
optic nerve information compression and to the LGN preprocessing^ this dependence may be highly nontrivial. 


5. CONCLUSIONS 

Even if much is known about the computations performed by primary visual cortex VI, still many problems 
concerning the fine structure of these computations as well as their purposes in the processing of visual information 
are open. This paper has focused on a restricted class of behaviors concerning classical receptive fields, which 
provide a primal linear response of VI neurons to visual stimuli that is later processed by nonlinear mechanisms 
and by dynamical lateral and feedback connectivities. Many studies approach the computation implemented 
by VI as being optimized for best information detection (even if other purposes have been proposed, such as 
that of maximizing inferenc^^ via BayesiarP^ schemes), and we have provided evidence that some of the design 
principles encountered in VI are actually compatible with this view. The presented approach focuses on the 
geometry of classical receptive fields, by considering their contribution to neural code as a linear wavelet analysis 
of visual stimuli. Due to the prominent role of selectivity for local orientation, the substructure given by the group 
of translations and rotations has been often considered in relation with with the cortical two dimensional space- 
frequency analysis jllllZI as well as with the modeling of contour perception and of lateral connectivities JIS1123I111 
and it has provided a fruitful environment for cortical-inspired image processing on groupsEUE^ More in general, 
the geometry associated to VI receptive profiles has provided a well-established set of models of the cortical 
architecture,!!^ and is thought to play a key role in the constitution of perceptual unitsEHIIfH Most of this 
geometry can be obtained by experimental setups that make use of parametric sets of simple stimuli, but the 
more recent approach to the study of receptive fields is actually based on the exploitation of nonlinearities 
and on the use of natural stimuli.!^ This provides indeed the framework for obtaining families of receptive 
field-like linear analyzers in terms of optimality criteria extracted from the statistics of natural images 
and to reconcile some behaviors observed in VI with recent approaches to high dimensional statistics, such as 
compressed sensing and sparsity E31I1ZI On the other hand, still much of the linear behavior continues to provide 
unsolved problems form the point of view of the strategies used by VI for collecting informations. We have 
mentioned that of characterizing the space of signals that can be represented by VI classical receptive fields, but 
also the appearance of quasi-periodic structures in the space of coefficients of a Gabor-like system seems to be 
suggestive in view of recent advances on similar approaches to sampling problems.!^ Moreover, the energy model 
for complex cells activity should be actually related to issues of phase retrieval^ Finally, the way nonlinearities 
intervene into the neural coding seems to be quite unusual with respect to the mainstream approaches to nonlinear 
approximation, as some of them seem to act mainly as deformations of the linear behavior^ with frequent evidence 
of adaptivity mechanisms. Few theoretical studies in approximation theory deal with similar kinds of nonlinear 
behaviors,!^ which however could provide effective alternative strategies from the ones presently considered in 
signal processing. 


13 







REFERENCES 

[1] S. T. Ali, J.-P. Antoine, J.-P. Gazeau, Coherent states, wavelets and their generalizations. Springer, 2^^ Ed. 
2014. 

[2] A. Afgoustidis, Orientation Maps in VI and Non-Euelidean Geometry. J. Math. Neurosci. 5:12 (2015). 

[3] A. Angelucci, J. B. Levitt, E. J. S. Watson, J.-M. Hupe, J. Bullier, J. S. Lund, Cireuits for Loeal and Global 
Signal Integration in Primary Visual Cortex. J. Neurosci. 22:8633-8646 (2002). 

[4] A. Angelucci, P. C. Bressloff, Contribution of feedforward, lateral and feedbaek eonneetions to the elassieal 
reeeptive field eenter and extra-elassieal reeeptive field surround of primate VI neurons. Prog. Brain Res. 
154:93-120 (2006). 

[5] J.-P. Antoine, R. Murenzi, P. Vandergheynst, S. T. Ali, Two-dimensional wavelets and their relatives. 
Cambridge University Press 2004. 

[6] D. Barbieri, G. Citti, G. Sanguinetti, A. Sarti, An uneertainty prineiple underlying the funetional arehiteeture 
of VI. J. Physiol.-Paris 106:183-193 (2012). 

[71 D. Barbieri, G. Citti, Reprodueinq kernel Hilbert spaees of CR funetions for the Euelidean motion group. 
Anal. Appl. 13:331-346 (2015). 

[8] D. Barbieri, G. Citti, A. Sarti, How uneertainty bounds the shape index of simple eells. J. Math. Neurosci. 
4:5 (2014). 

[9] D. Barbieri, G. Citti, G. Cocci, A. Sarti, A eortieal-inspired geometry for eontour pereeption and motion 
integration J. Math. Imaging Vision 49:511-529 (2014). 

[10] M. V. Berry, M. R. Dennis, Phase singularities in isotropie random waves. Proc. R. Soc. Lond. A 456:2059- 
2079 (2001). 

[11] 1. Bojak, D. T. J. Liley, Axonal veloeity distributions in neural field equations. PLoS Comput. Biol. 
6:el000653 (2010). 

[12] W. H. Bosking, Y. Zhang, B. Schofield, D. Eitzpatrick, Orientation seleetivity and the arrangement of 
horizontal eonneetion in tree shrew striate eortex. J. Neurosci. 17:2112-2127 (1997). 

[13] W. H. Bosking, J. C. Crowley, D. Eitzpatrick, Spatial eoding of position and orientation in primary visual 
eortex. Nature Neurosci. 5:874-882 (2002). 

[14] T. Bonhoeffer, A. Grinvald, Optieal Imaging based on intrinsie signals: the methodology. In “Brain mapping; 
the methods”. A. W. Toga and J. C. Mazziotta (eds.). Academic Press 1996. 

[15] P. C. Bressloff, Waves in neural media. Springer 2014. 

[16] M. Carandini et ah. Do we know what the early visual system does? J. Neurosci. 25:10577-10597 (2005). 

[17] M. Carandini, D. J. Heeger, Normalization as a eanonieal neural eomputation. Nature Rev. Neurosci. 13:51- 
62 (2012). 

[18] G. Citti, A. Sarti, A eortieal based model of pereeptual eompletion in the roto-translation spaee. J. Math. 
Imaging Vision 24:307-326 (2006). 

[19] G. Citti, A. Sarti, Neuromathematies of Vision. Springer 2014. 

[20] G. Citti, A. Sarti, A Gauge Eield Model of Modal Completion. J. Math. Imaging Vision 52:267-284 (2015). 

[21] G. Cocci, D. Barbieri, A. Sarti, Spatiotemporal reeeptive fields of eells in VI are optimally shaped for stimulus 
veloeity estimation. J. Opt. Soc. Am. A 29:130-138 (2012). 

[22] G. Cocci, D. Barbieri, G. Citti, A. Sarti, Cortieal Spatiotemporal Dimensionality Reduetion for Visual 
Grouping. Neural Comput. 27:1252-1293 (2015). 

[23] S. Coombes, R. Thul, K. C. A. Wedgwood, Nonsmooth dynamies in spiking neuron models. Physica D 
241:2042-2057 (2012). 

[24] M. C. Crair, E. S. Ruthazer, D. C. Gillespie, M. P. Stryker, Oeular Dominanee Peaks at Pinwheel Center 
Singularities of the Orientation Map in Cat Visual Cortex. J. Neurophysiol. 77:3381-3385 (1997). 

[25] P. M. Daniel, D. Whitteridge, The representation of the visual field on the eerebral eortex in monkeys. J. 
Physiol. 159:203-221 (1961). 

[26] P. Dayan, L. E. Abbott, Theoretieal Neuroseienee. MIT Press 2001. 

[27] G. C. DeAngelis, 1. Ohzawa, R. D. Ereeman, Reeeptive-field dynamies in the eentral visual pathways. Trends 
Neurosci. 18:451-458 (1995). 


14 



[28] R. L. De Valois, K. K. De Valois, Spatial Vision. Oxford University Press 1990. 

[29] R. Duits, H. Fiihr, B. Janssen, M. Bruurmijn, L. Florack, H. van Assen, Evolution equations on Gabor 
transforms and their applieations. Appl. Comput. Harmon. Anal. 35:483-526 (2013). 

[30] R. Durbin, G. Mitchinson, A dimension reduetion framework for understanding eortieal maps. Nature 
343:644-647 (1990). 

[31] M. Ehler, M. Fornasier, J. Sigl, Quasi-linear eompressed sensing. Multiscale Model. Simul. 12:725-754 (2014). 

[32] G. Felsen, Y. Dan, A natural approaeh to studying vision. Nature Neurosci. 8:1643-1646 (2005). 

[33] D. Fitzpatrick, Seeing beyond the reeeptive field in primary visual eortex. Curr. Opin. Neurobiol. 10:438-443 

( 2000 ). 

[34] A. K. Fletcher, S. Rangan, L. R. Varshney, A. Bhargava, Neural Reeonstruetion with Approximate Message 
Passing. Adv. Neur. In. 24:2555-2563 (2011). 

[35] P. Fries, J.-H. Schroder, P. R. Roelfsema, W. Singer, A. K. Engel, Oseillatory Neuronal Synehronization in 
Primary Visual Cortex as a Correlate of Stimulus Seleetion. J. Neurosci. 22:3739-3754 (2002). 

[36] K. Eriston, A theory of eortieal responses. Phil. Trans. R. Soc. B 360:815-836 (2005). 

[37] S. Ganguli, H. Sompolinsky, Compressed Sensing, Sparsity, and Dimensionality in Neuronal Information 
Proeessing and Data Analysis. Annu. Rev. Neurosci. 35:485-508 (2012). 

[38] J. L. Gardner, A. A. Anzai, I. Ohzawa, R. D. Ereeman, Linear and nonlinear eontributions to orientation 
tuning of simple eells in the eaPs striate eortex. Visual Neurosci. 16:1115-1121 (1999) 

[39] R. Gattass, G. G. Gross, J. H. Sandell, Visual topography of V2 in the Maeaque. J. Gomp. Neurol. 201:519- 
539 (1981). 

[40] W. Gerstner, W. M. Kistler, Spiking neuron models. Gambridge University Press 2002. 

[41] K. Grill-Spector, R. Malach, The Human Visual Cortex. Annu. Rev. Neurosci. 27:649-677 (2004). 

[42] B. M. Harvey, S. O. Dumoulin, The Relationship between Cortieal Magnifieation Faetor and Population 
Reeeptive Field Size in Human Visual Cortex: Constaneies in Cortieal Arehiteeture. J. Neurosci. 31:13604- 
13612 (2011). 

[43] J. C. Horton, D. L. Adams, The eortieal eolumn: a strueture without a funetion. Philos. T. R. Soc. B 
360:837-862 (2005). 

[44] D. H. Hubei, T. N. Wiesel, Uniformity of Monkey striate eortex. A parallel relationship between field size, 
seatter and magnifieation faetor. J. Gomp. Neurol. 158:295-306 (1974). 

[45] D. Hubei, Eye brain and vision. Ereely available at http://hubel.med.harvard.edu/ (1988). 

[46] M. Hiibener, D. Shoham, A. Grinvald, T. Bonheffer, Spatial Relationships among Three Columnar Systems 
in Cat Area 17. J. Neurosci. 17:9270-9284 (1997). 

[47] G. Huguet, J. Rinzel, J.-M. Hupe, Noise and adaptation in multistable pereeption: Noise drives when to 
switeh, adaptation determines pereept ehoiee. J. Vision 14:19 (2014). 

[48] N. P. Issa, G. Trepel, M. P. Stryker, Spatial Frequeney Maps in Cat Visual Cortex. J. Neurosci. 20:8504-8514 

( 2000 ). 

[49] S. Jayasuriya, Z. P. Kilpatrick, Effeets of time-dependent stimuli in a eompetitive neural network model of 
pereeptual rivalry. B. Math. Biol. 74:1396-1426 (2012). 

[50] C. Kalisa, B. Torresani, N-dimensional affine WeyI-Heisenberg wavelets. Ann. I. H. Poincare A 59:201-236 
(1993). 

[51] M. Kaschube, M. Schnabel, S. Lowel, D. M. Goppola, L. E. White, E. Wolf, Universality in the Evolution 
of Orientation Columns in the Visual Cortex. Science 330:1113-1116 (2010). [Includes Online Material] 

[52] W. Keil, E. Wolf, Coverage, eontinuity, and visual eortieal arehiteeture. Neural Syst. Circuits 1:17 (2011). 

[53] T. S. Lee, Image representation using 2-D Cabor wavelets. IEEE T. Pattern Anal., 18:959-71 (1996). 

[54] D. Marr, T. Poggio, E. Hildreth, Smallest ehannel in early human vision. J. Opt. Soc. Am. 70:868-870 
(1980). 

[55] B. Matei, Y. Meyer, Quasierystals are sets of stable sampling. C. R. Acad. Sci. Paris Ser. I Math. 346:1235- 
1238 (2008). 

[56] R. Miikkulainen, J. A. Bednar, Y. Choe, J. Sirosh, Computational Maps in the Visual Cortex. Springer 
2005. 


15 


[57] 1. Nauhaus, A. Benucci, M. Carandini, D. L. Ringach, Neuronal Selectivity and Local Map Structure in 
Visual Cortex. Neuron 57:673-679 (2008). 

[58] E. Niebur, F. Worgotter, Design Principles of Columnar Organization in Visual Cortex. Neural Comput. 
6:602-614 (1994). 

[59] K. Ohki, S. Chung, P. Kara, M. Hiibener, T. Bonhoeffer, R. Clay Reid, Highly ordered arrangement of single 
neurons in orientation pinwheels. Nature 442:925-928 (2005). 

[60] B. A. Olshausen, D. J. Field, Sparse coding with an overcomplete basis set: a strategy employed by VI ? 
Vision Res. 37:3311-3325 (1997). 

[61] J. Ribot, Y. Aushana, E. Bui-Quoc, C. Milleret, Organization and Origin of Spatial Freguency Maps in Cat 
Visual Cortex. J. Neurosci. 33:13326-13343 (2013). 

[62] D. Ringach, Spatial structure and symmetry of simple cells receptive fields in macague primary visual cortex. 
J. Neurophysiol. 88:455-463 (2002). 

[63] D. L. Ringach, M. J. Hawken, R. Shapley, Dynamics of Orientation Tuning in Macague VI: The Role of 
Global and Tuned Suppression. J. Neurophysiol. 90:342-352 (2002). 

[64] A. Romagnoni, J. Ribot, D. Bennequin, J. Touboul, Parsimony, exhaustivity and balanced detection in 
neocortex. Preprint, http://arxiv.org/abs/1409.4927 

[65] M. G. P. Rosa, R. Tweedale, Maps of the Visual Field in the Cerebral Cortex of Primates: Functional 
Organization and Significance. In “The Primate Visual System”, J. H. Kaas, C. E. Collins (eds.). CRC 
Press 2005. 

[66] G. Sanguinetti, G. Gitti, A. Sarti, A model of natural image edge co-occurrence in the rototranslation group. 
J. Vision 10:37 (2010). 

[67] A. Sarti, G. Citti, J. Petitot, The symplectic structure of the primary visual cortex. Biol. Gybern. 98:33-48 
(2008). 

[68] A. Sarti, G. Citti, The constitution of visual perceptual units in the functional architecture of VI. J. Comput. 
Neurosci. 38:285-300 (2015). 

[69] M. P. Sceniak, M. J. Hawken, R. Shapley, Contrast-Dependent Changes in Spatial Freguency Tuning of 
Macague VI Neurons: Effects of a Changing Receptive Field Size. J. Neurophysiol. 88:1363-1373 (2002). 

[70] U. Sharma, R. Duits, Left-invariant evolutions of wavelet transforms on the similitude group. Appl. Comput. 
Harmon. Anal. 39:110-137 (2015). 

[71] Y. Shechtman, Y. C. Eldar, O. Cohen, H. N. Chapman, J. Miao, M. Segev, Phase Retrieval with Application 
to Optical Imaging. Preprint, http://arxiv.org/abs/1402.7350 

[72] E. P. Simoncelli, L. Paninski, J. Pillow, O. Schwartz, Characterization of Neural Responses with Stochastic 
Stimuli. In “The New Cognitive Neurosciences”, 3^^ Ed., M. Gazzaniga (ed.). MIT Press 2004. 

[73] L. Sirovich, R. Uglesich, The organization of orientation and spatial freguency in primary visual cortex. 
Proc. Natl. Acad. Sci. USA 101:16941-16946 (2004). 

[74] N. V. Swindale, Orientation tuning curves: empirical description and estimation of parameters. Biol. Gy¬ 
bern. 78:45-56 (1998). 

[75] N. V. Swindale, D. Shoham, A. Grinvald, T. Bonhoeffer, M. Hiibener, Visual cortex maps are optimized for 
uniform coverage. Nature Neurosci. 3:822-826 (2000). 

[76] D. Teller, Vision and the visual system. Notes, http://faculty .Washington. edu/jpalmer/files/Teller/ 

[77] A. Tonda, E. Button, G. Squillero, P.-H. Wuillemin, A memetic approach to bayesian network structure 
learning. Beet. Notes Gomput. Sc. 7835:102-111 (2013). 

[78] S. D. Van Hooser, J. A. F. Heimel, S. Ghung, S. B. Nelson, B. J. Toth, Orientation Selectivity without 
Orientation Maps in Visual Cortex of a Highly Visual Mammal. J. Neurosci. 25:19-28 (2005). 

[79] W. E. Vinje, J. B. Gallant, Sparse Coding and Decorrelation in Primary Visual Cortex During Natural 
Vision. Science 287:1273-1276 (2000). 

[80] M. A. Webster, R. B. De Valois, Relationship between spatial-freguency and orientation tuning of striate- 
cortex cells. J. Opt. Soc. Am. A 2:1124-1132 (1985). 

[81] E. Yacoub, N. Hard, K. Ugurbil, High-field fMRI unveils orientation columns in humans. Proc. Natl. Acad. 
Sci. USA 105:10607-10612 (2008). 

[82] S. W. Zucker, Which computation runs in visual cortical columns? In “23 Problems in Systems Neuro¬ 
science”, J. B. van Hemmen, T. J. Sejnowski (eds.). Oxford University Press 2006. 


16 


